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Wo present a study of resonances in exclusive decays of B mesons to D^*^D^*^ K. We report the 
observation of the decays B — > D'*' 73^]^ (2536) where the /3^i(2536) is reconstructed in the D*'^K'^ 
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and D*'^Ks decay channels. We report also the observation of the decays B ip{3770)K where the 
i/j(3770) decays to D^D^^ and D~ . In addition, we present the observation of an enhancement 
for the D*°D° invariant mass in the decays B D'^D^K, at a mass of (SSTS.ltJ^'g ± 0.5) MeV/c^ 
with a width of (S.OtJ j ± 0.9) MeV (the first errors are statistical and the second are systematic). 
Branching fractions and spin studies are shown for the three resonances. The results are based on 
347 fb"^ of data collected with the BABAR detector at the PEP-II B factory. 

PACS numbers: 13.25.Hw, 12.15.Hh, ll.30.Er 



In this article, we study the production of _D^j^(2536), 
i/'(3770) and X(3872) resonances in decays of charged 
and neutral B mesons to D^*^D^*^K. Here, D^*^ is either 
a D°, D*°, D+ or D*+ , is the charge_conjugate of 

and K is either a K+ or a K% Both Z)(*) and 
are fully reconstructed. Charge conjugate reactions are 
assumed throughout this article. 

The 2?^]^ (2536) resonance is the narrow P-wave 
meson with ~ 1+ assignment strongly favored. It 
can be produced in B £)(*^Dj^(2536) decays and 
should decay dominantly to D*°if+ and D*^ Ev- 
idence for Dj"^(2536) production in B decays was found 
by BaBAR in the sum of all D^*'>D*°K+ final states 11 
and more recently in the decay B° D*~ D*'^ [3]. 
For most of the B _D(*)D+ (2536) modes, only Hm- 
its have been placed on the branching fractions We 
report herein branching fraction measurements of B — > 
£)(*)£)+ (2536) decays, through a comprehensive study of 
both D^*^D*°K+ and D^*')D*+K° final states. 

The '0(3770) meson is a charmonium state with — 
1^, with a mass just above the open charm threshold. 
This meson is thought to be an admixture of the D-wave 
and S'-wave of the angular momentum eigenstates of cc 
system. Study of this state in B decays and branching 
fraction measurements could provide more information 
on the structure of the ^'(3770) wave function. This res- 
onance decays dominantly to D°D° and D~ and 
was observed in B meson decays by the Belle experi- 
ment We present a study of the DD mass distribu- 
tion in DDK events. 

The X(3872) resonance was discovered by Belle in 
the invariant mass distribution of J/ipn'^n^' produced 
in B J/il)'K~^TT~ K decays, and was thereafter con- 
firmed by BaBAR, do and CDF This new meson 
has a mass of 3871.2 ± 0.5MeV/c^ and a natural width 
less than 2.3 MeV at 90% confidence level (C.L.). At 
present, the quantum numbers compatible with the ob- 
servations are J^^ = 1++ or 2 ^ Recently, Belle 
showed an excess of events in the D^D^n^ invariant 
mass in the channel B D'^D'^tt^K, with a mass of 
3875.2 ± 0.7t°i ± 0.8MeV/c2 (where the third er- 
ror is due to the uncertainty in the neutral D mass). 
The X(3872) is probably not a charmonium state, given 
its measured mass and width, and several alternative 
interpretations have been proposed: D*^D'^ molecule, 
tetraquark state, hybrid or gluonium states Q. We 
present a search for X(3872) decays to D*°D°. 



The measurements reported here use 347 fb"^ of data, 
corresponding to (383±4) x 10^ BB pairs, collected at the 
T{AS) resonance with the BaBAR detector at the PEP-II 
B factory. The BaBAR detector is described in detail else- 
where [21]. We use a Monte Carlo (MC) simulation based 
on GEANT4 to study the relevant backgrounds and 
estimate the selection efficiencies. 

The B^ and B~^ mesons are reconstructed in a sample 
of hadronic events in the 22 possible D^*'> D^*") K modes. 
The selection criteria are optimized for each final state 
by maximizing the significance S/^/S + B, where S and 
B refer to the expected number of signal and background 
events, based on MC simulation. The K'^ candidates are 
reconstructed from two oppositely charged tracks con- 
sistent with coming from a common vertex and hav- 
ing an invariant mass within ±9.5MeV/c^ of the nom- 
inal Kg mass. For some channels, depending on the 
background level, we apply a requirement on the dis- 
placement of the /Cg vertex in the plane transverse to 
the beam axis of at least 0.2 cm. The tt" candidates 
are reconstructed from pairs of photons with energies 
> 30 MeV in the laboratory frame that have an in- 
variant mass of 115 < m^j < 150 MeV/ c^. We recon- 
struct D mesons in the modes D'^ — > K^tt^, K^tt^tt'^, 
K^TT^TT~Tr~^ , and Z?+ K'tt^tt'^. The K and n tracks 
are required to originate from a common vertex. Charged 
kaon identification, based on the Chcrcnkov angle and 
the dE/dx measurements, is used for K~^ from B de- 
cays and from most D decays. The invariant masses of 
the D candidates are required to be within ±2a of the 
measured D mass. The measured D mass resolution, 
tJD, is 13 MeV/ for D^ K'tt^tt^ and varies from 5.5 
to 7MeV/c^ for the other modes. The D* candidates 
are reconstructed in the decay modes D*^ D^tt"*", 
D*+ ~* D+ttO, D*o ^ DOttO, and D*° ^ D°j. The 
tt'^ and the 7r+ must have momentum below 450MeV/c 
in the T(4S') rest frame, while the 7 energy in the labo- 
ratory frame must be greater than 100 MeV. The mass 
difference between the D* and D candidates is required 
to be within 3 MeV/c^ of the nominal value [Tl for Z?*+ de- 
cays (4MeV/c2 and lOMeV/c^ for D° tt^ and D*^ 

D'^ 7, respectively). The mode D*^ ZJ+tt'^ is used 
only in the reconstruction of decays B° D*^ D*^ K^ 
and B+ D*-D*+K+. 

B candidates are reconstructed by combining a D'^*\ a 
-D^*-' and a K candidate. For most of the modes involving 
two -D" mesons, at least one of them is required to decay 
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to K~'K'^ . During the optimization process, we remove 
D decay modes if the significance for a particular B de- 
cay mode improves. In practice, only D*~^ K'^ decays 
benefit from this optimization, for which we remove the 
combination with the first meson of the decay chain 
going to K^TT^ and the second going to K^tt^tt^tt^ 
(and vice- versa). A mass-constrained kinematic fit is ap- 
plied to the intermediate particles £)+, 
K^, TT*^) to improve their momentum resolution. For the 
Z)" and the D* — mass differences, we use the recent 
CLEO measurement of the mass . To suppress the 
e^e^ qq (q = u, d, s and c) continuum background, we 
perform a selection based on the ratio of the second to 
zeroth Fox- Wolfram moments of the event [l^ and on 
the cosine of the angle between the thrust axis of the 
candidate decay and the thrust axis of the rest of the 
event. Signal events have rriES — •\/s/4 — p'^, where 
p*Q is the ccnter-of-mass momentum of the B candidate, 
compatible with the known B meson mass, and a differ- 
ence between the candidate energy and the beam energy 
in the center-of-mass, AE, compatible with 0. On aver- 
age we have about 1.8 signal B candidates per event. If 
more than one candidate is selected in an event, we retain 
the one with the smallest |Ai?|. In the final selection, we 
require \AE\ to be less than na^E, where the resolution 
CAE varies between 7 and 14 MeV and n is determined 
for each mode by the optimization procedure (n ranges 
from 1 to 4). For each mode we define a B signal region 
< "iT^ES < tties^i where ranges from 5.268 

to 5.277 GeV/c^, and mf^ from 5.284 to 5.290 GeV/c^, 
and a control region, 5.20 < niES < 5.26GeV/c^. The 
signal purity obtained in the signal region ranges from 17 
to 77%, depending on the mode. 

We consider several sources of systematic errors. From 
the difference between data and Monte Carlo efficiencies 
we derive systematic errors of 0.5% per charged track, 
2.2% per soft pion from D* decays, 2.5% per K^, 2% per 
K~^, 3% per 7r° and 2% per single photon. As an exam- 
ple, the particle identification efficiency for is mea- 
sured using a D*"*" D^tt"*" data control sample with 
D'^ K~Tr~^. Other sources of systematic error are also 
taken into account: limited MC statistics (1-3%), the es- 
timate of the total number of B mesons in the data sam- 
ple (1.1%), uncertainties on the Z?'*' and K'^ branching 
fractions (3-8%) and uncertainties on the D'^*^ and K 
masses (0.5-6%). In addition, there are uncertainties in 
the fit procedure for the different resonances: when fix- 
ing a parameter, we repeat the fit varying the parameter 
by zbltJ of its error (where a is the 68% C.L. standard 
deviation); these uncertainties include also variation of 
the background parametrization. Using the jties con- 
trol region, we check that the combinatorial background 
events do not contain any significant Dj"^(2536), V'(3770) 
or X(3872) signals or additional peaking structures. Fur- 
thermore, for the mass and width measurements, we in- 
clude effects from the energy loss in the tracking system. 



from the uncertainties on the magnetic field and from the 
calibration and background of the calorimeter. 

We search for D+(2536) decaying_to D*+K° and 
D*'^K+_asing B° JD^*'^- K+ , D^*'i-D*+K° and 
B+ ^ D^*^^D*^K+, D^*^°D*+K"s candidates. We show 
in Fig. [T]a, the D*^K^ and D*'^K^ invariant mass dis- 
tribution for the sum of the eight B modes. The over- 
laid curve is the result of a unbinned extended maxi- 
mum likelihood fit. Since the I?j"j^(2536) meson is nar- 
row (r^+(2536) < 2.3 MeV at 90% C.L. [l]), the in- 
variant mass peak is described by the convolution of a 
non-relativistic Breit-Wigner with a Gaussian function 
(called a Voigtian function) and the background by a 
threshold function a{m — mof x e'^*-'""™"-*, where m is 
the D* K invariant mass, mo is the sum of the D* and 
K meson masses, and a, h and c are parameters of the 
fit. To take into account the large tails in the recon- 
struction of D+i(2536) D*°K+ decays, the probabil- 
ity density function (PDF) for the D*°K~^ modes is con- 
structed from a sum of a Voigtian function and a Gaus- 
sian function, with a common mean. The D^^ (2536) mass 
and yield are floating parameters in the fit. The natu- 
ral width of the Z?^]^(2536) is fixed to IMeV and varied 
from 0.1 to 2.0 MeV to estimate systematic errors. The 
other parameters (the second Gaussian function and the 
relative contribution of the Voigtian and the Gaussian 
function) are taken from the simulation. A significant 
signal is observed in each of the modes separately (see 
Table[l|. A fit to the eight B modes gives 182 ± 19 events 
in the peak with a statistical significance of 11.8(7. We 
compute an estimate of the statistical significance calcu- 
lating PR0B(2(Lo - ^signal), A^dof), where Lo(signai) is the 
minimum of the likelihood without (with) the signal con- 
tribution, A'dof is the number of free parameters in the 
signal PDF and PROB is the upper tail probability of a 
chi-squared distribution, converting this probability into 
a number of standard deviations. 

From the Dj"^(2536) yields, we compute cross-feed- 
corrected branching fractions, using the signal efficiency 
and the relative contributions from cross-feed between 
the different B D'-*^ D^^{2536) channels, as obtained 
from simulated events. The resulting branching frac- 
tions, the efficiencies, including the intermediate branch- 
ing fractions, and the internal cross-feed contributions 
are given in Table [J In addition to the effects previ- 
ously mentioned, systematics in the table include un- 
certainties from the cross- feed events (0-3%), underes- 
timate of the MC resolution (1-10%) and uncertainty on 
the Z?^j^(2536) natural width (5-18%). Using only modes 
containing D*^Kl in order to minimize the systematic 
error, we also fit the 1?+ (2536) mass, M(D+(2536)) = 
(2534.78 ± 0.31 ± 0.40) MeV/c^. Our measurement is in 
good agreement with the world average [H. 

The helicity angle distribution for the sum of the 
four B — > Z?_Dj']^(2536) modes, determined by fitting the 
D*K mass distribution for the -D^]^(2536) yield in ten 
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FIG. 1: Top: Invariant mass distributions of D* K (a), DD (c) and D*^D^ (e) in the data for events in the {niBS, AE) B signal 
region. Points with statistical errors are data events, the solid line represents the fit to the data, the dashed line shows the 
contribution of the ^)J^(2536) (a), ?/;(3770) (c) and X(3872) (e) signals, and the dotted line shows the background contribution. 
Bottom: background-subtracted and efficiency-corrected helicity angle distributions for the D^j^ (2536) (b) (containing only the 
B — > 73D^j^(2536) modes), '0(3770) (d) and X(3872) (f) signals in the data (points with statistical errors) and fitted distributions 
for different spin hypotheses: = 0"'' (dashed lines), f ~ (solid), f^ with S-D wave admixture (dotted), 2~ (long-dashed) and 
2+ (dotted-dashed). 



COS 9j-i+ (2530) bins, is shown in FiglTja. Here 6*^+ (2530) is 
defined as the angle between the D* direction and the 
B direction in the Z?j^]^(2536) frame. We fit the hehcity 
distribution to different spin-parity hypotheses (one free 
parameter for = 1" and 2+, and two free parameters 
for = 1+ and 2-). The fits to = 1+ in pure S 
wave (flat distribution, not shown in the figure), J^=l+ 
with S-D wave admixture, and J^ = l" are all in good 
agreement with data, with x^/n.d.f. of 15.9/9, 9.3/8 and 
9.6/9 respectively. Fits to J^=2'^ and 2~ are disfavored, 
with x^/n-d.f. of 26.0/9 and 26.0/8 respectively. 

We search for B+{B°) ij{3770)K+{K°) with 
?/;(3770) D-D+, D°D". In Fig. [it we show the DD 
invariant mass for the sum of B~^ D^D^K^ and 
B'^ — !■ D~D~^K^ candidates. No significant signal is 
observed in the DDK^ modes. The curve shown is the 
result of a fit where the ■0(3770) peak is described by a 
P-wave Breit-Wigner with the mass as a free parameter 
in the fit and a natural width fixed to 23 MeV [3] , while 
the background is described by the threshold function 
described previously. We observe 57 ± 11 events, with 
a statistical significance of 6.4tT, from which we obtain 
M(V'(3770)) = (3775.5±2.4±0.5) MeV/c^, in good agree- 
ment with the recent high precision measurement of the 
BES collaboration [l3|. We obtain the branching frac- 
tions, or limits, reported in Table HI by fitting separately 
the B+ D"D"K+, B° D"D"K% B+ D- D+ K+ 



and B° D-D+K^ channels, with M(?A(3770)) fixed 
to the result of the combined fit. 

For the two modes with significant signal, we study the 
-0(3770) helicity angle, ^^(3770) (Fig. [TJi), defined as the 
angle between the D^/^ direction and the B direction in 
the -0(3770) frame. We confirm the spin 1 assignment of 
the i/)(3770) (x^/n.d.f.==2.9/9). A spin hypothesis gives 
xVn.d.f.=22.0/9. 

We_ search for decays B X{3872)K, X(3872) 
D*°D° in the B+{B°) D"D*°K+{K"^) + 

D*°D°K+{K°) samples. We plot the D*°D° invariant 
mass distribution for the sum of B° and B~^ candidates in 
Fig. [It. Due to the proximity of the threshold and to the 
fact that the natural width of the X(3872) is comparable 
to the mass resolution, there is no easy analytic 

parametrization of the reconstructed ^(3872) mass spec- 
trum. To measure the mass and width of the X(3872), we 
generate and reconstruct high statistics MC samples of 
B X(3872)K events with various masses (from 3872 
to 3877 MeV/c^) and widths (from to 20 MeV), as- 
suming a pure S-wave decay of a spin 1 resonance. We 
perform binned extended maximum likelihood fits to the 
measured D*^D^ invariant mass distributions using these 
different MC samples as signal PDFs combined with a 
threshold function for the background. We compare the 
agreement of each mass and width hypothesis to the data 
by computing the of the fit for the sum of bins below 
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3.9GeV/c^. Figure [2] shows the interpolated — Xmin 
contours versus the simulated masses and widths of the 
different signal samples, where Xmin value for the 

best fit. This best fit gives 33 ± 7 events in the X(3872) 
peak, with a statistical significance of 4.9ct. Mass and 
width central values are obtained at the minimum of the 
distribution, while the errors are given by the extreme 
points of the contour in the (mass, width) plane defined 
at Xmin+1- We obtain a mass of (3875.lt^;^±0.5) MeV/c^ 
and a width of (3.0l^;4 ± 0.9) MeV, where the systematic 
errors include additional contributions from the choice 
of the bin width of the invariant mass distribution (0.14 
MeV/c^ and 0.07 MeV respectively on the mass and on 
the width) and from the fact that in the MC we assume 
S-wave X(3872) decays to D*°D° (0.20 MeV/c^ and 0.80 
MeV respectively on the mass and on the width, deter- 
mined using MC events with P-wave X(3872) decays). 
Independently of the mass value, the width measure- 
ment is 1.8(7 away from OMeV. The _B+ and i?° branch- 
ing fractions to X{3872)K (reported in Table [l| are ob- 
tained by fitting the D*'^D'^ invariant mass spectra, sep- 
arately for B+ and choosing the MC sample with 
M(X(3872)) = 3875MeV/c2 and r(X(3872)) = 3 MeV, 
which is found to give the best fit to the data. 

We study the hehcity angle of the X(3872), ^^x(3872), 
for the sum of and modes (see Fig. [Tf). Here, 
^x(3872) is defined as the angle between the D° or di- 
rection and the B direction in the X{3872) frame. Com- 
paring the curves obtained with different spin hypothe- 
ses with the data distribution, we obtain the following 
xVn.d.f.: 9.8/7 for = 1", 3.9/7 for 1+ assuming a 
pure S wave (flat distribution, not shown in the figure), 
2.5/6 for 1+ with S-D wave admixture, 5.9/7 for 2+ and 
2.7/6 for 2^. On the basis of this data sample, we can- 
not distinguish the different spin assignments. However 
the D*°D° decay would be suppressed by the angular 
momentum barrier for J = 2. 

The ratio of X(3872) candidates reconstructed in the 
WD^tt^ and WD°"f final states is 1.37 ± 0.56 (statis- 
tical error only), while we expect 1.30 for a decay that 
proceeds exclusively via a D*^ meson. In addition, we 
measure parameters which can be used to differentiate 
various theoretical interpretations [1, [3]: Am, the mass 
difference between the state seen in decays and B'^ 
decays, as well as i?o/+j the ratio of branching fractions 
between B^ decays and B'^ decays. Assuming that the 
signal seen in B'^ decays is not a statistical fluctuation, 
we obtain Am = (0.7 ± 1.9 ± 0.3) MeV/c^ and i?o/+ = 
1.33 ±0.69 ±0.43. 

In summary, we report the observation of the eight 
B (2536) decays, with a L'+i(2536) mass of 

(2534.78 ± 0.31 ± 0_^0) MeV/c^. We observe the ^(3770) 
resonance in B — > DDK decays and measure its mass to 
be (3775.5±2.4±0.5) MeV/c^ We show that an enhance- 
ment of data is observed near the limit of phase space for 
the D*'^D^ invariant mass, at a mass of (3875. iIq ^ ± 
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FIG. 2: Equidistant contours of ~ Xmin versus mass and 
width of the simulated X(3872) signals. The contours are 
separated by values of 0.5. Solid contours represent values 
starting from 0.5, by step of 1, while dashed contours rep- 
resent values starting from 1, by step of 1. The contour at 
— Xmin = 1 is indicated by a wider line. The cross shows 
the central values of the X(3872) mass and width. The verti- 
cal and horizontal dotted lines indicate the errors on the mass 
and on the width respectively. 



0.5) MeV/c2, with a width of (3.0^};^ ± 0.9) MeV. This 
enhancement could be interpreted as the X(3872), al- 
though the observed mass is 4.5<7 away from the mass 
measured in the J/^/jtt+tt^ decay mode. Our mass value 
is in good agreement with the value measured by Belle 
in the WD^tt^^ final state. 
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TABLE I; Fitted event yields, number of events attributed to internal cross-feed events, efficiencies e (including intermediate 
branching fractions), final branching fractions, B, and statistical significances for B D^'^Dj'j (2536) followed by D^j^(2536) 
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significance is less than or equal to 3cr (these limits use the profile likelihood method 15] and include systematic errors). The 
first error on B is statistical and the second is systematic. 
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